Hearing a talking face: an auditory influence on a visual detection task

نویسندگان

  • Jeesun Kim
  • Christian Kroos
  • Chris Davis
چکیده

Parsing of information from the world into objects and events occurs in both the visual and auditory modalities. It has been suggested that visual and auditory scene perception involve similar principles of perceptual organization. This study investigated cross-modal scene perception by determining whether an auditory stimulus could facilitate visual object segregation. Specifically, we examined whether the presentation of matched auditory speech would facilitate the detection of a point-light talking face amid point-light distractors. An adaptive staircase procedure (3 up 1 down rule) was used to estimate the 79% correct threshold in a twoalternative forced-choice (2AFC) procedure. To determine if different degrees of speech motion would show different sized auditory influence, three speech modes were tested (speech in quiet; whispered and Lombard speech). A facilitatory auditory effect on talking face detection was found; the size of this effect did not differ across the different speech modes.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Detection of audiovisual speech correspondences without visual awareness.

Mounting physiological and behavioral evidence has shown that the detectability of a visual stimulus can be enhanced by a simultaneously presented sound. The mechanisms underlying these cross-sensory effects, however, remain largely unknown. Using continuous flash suppression (CFS), we rendered a complex, dynamic visual stimulus (i.e., a talking face) consciously invisible to participants. We p...

متن کامل

Searching for a talking face: the effect of degrading the auditory signal.

Previous research (e.g., McGurk & MacDonald, 1976) suggests that faces and voices are bound automatically, but recent evidence suggests that attention is involved in a task of searching for a talking face (Alsius & Soto-Faraco, 2011). We hypothesized that the processing demands of the stimuli may affect the amount of attentional resources required, and investigated what effect degrading the aud...

متن کامل

Objective Peak-Detection in Complex Auditory Brainstem Response to /ba/, /da/, /ga/: A Novel Technique

Objectives: The result of auditory brainstem response is used worldwide for detecting hearing impairments or hearing aids. This study aimed to introduce the superiority of mathematical innovation algorithm toward subjective evaluation by an audiologist. The automatic algorithm method is encouraged for detecting the waves of Auditory Brainstem Response (ABR), because it can reduce subjective eva...

متن کامل

Contributions of oral and extraoral facial movement to visual and audiovisual speech perception.

Seeing a talker's face influences auditory speech recognition, but the visible input essential for this influence has yet to be established. Using a new seamless editing technique, the authors examined effects of restricting visible movement to oral or extraoral areas of a talking face. In Experiment 1, visual speech identification and visual influences on identifying auditory speech were compa...

متن کامل

Audio-Visual Prosody: Perception, Detection, and Synthesis of Prominence

In this chapter, we investigate the effects of facial prominence cues, in terms of gestures, when synthesized on animated talking heads. In the first study a speech intelligibility experiment is conducted, where speech quality is acoustically degraded, then the speech is presented to 12 subjects through a lip synchronized talking head carrying head-nods and eyebrow raising gestures. The experim...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008